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i J. 

This study refutes the Elashoff and Snow (1970) 
critique of "Pygmalion in the Classroom," a study by Rosenthal and 
Jacobson (1968) on the effect of favorable teacher expectance on 
pupil achievement. Among the theses considered erroneous are: (1) 

That there is a wide variation ^n apparent results when different 
methods of data analysis are employed; (2) That the statistically 
significant effects of teachfer expectation are dependent upon the 
choice of a particular method of data analysis; (3) That imbalance 
and doubtful randomization in the experimental and control groups 
invalidate the results of the analyses; and (4) That the study is 
isolated and unreplicated. (AG) 
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1 . Overview : Pygmalion In the Classroom Reaffirmed 



In this paper, an invited response to the critique of Rosenthal and 
Jacobson (1968) (RJ) given in Elashoff and Snow (1970) (ES) , we demonstrate 
that the ES document in way impugns the validity of the RJ experiment. 

A central thesis in ES is that there was a "wide variation in apparent 
results" when different methods of data analysis were employed, and that 
the statistically significant effects of teacher expectation reported by 
RJ were dependent upon the choice of a particular method of data analysis. 

This thesis is seriously in error. Indeed, as we shall show, the net 
effect of the varied statistical analyses carried out in ES is greatly to 
increase the cross-method generality of the results reported by RJ. 

A second thesis in ES is that "imbalance" and "doubtful randomization" 
in the experimental and control groups invalidate the results of the RJ 
ailalyses. As we shall demonstrate, there is absolutely no reason to 
doubt the validity of the results of RJ. 

A third thesis in ES is that the RJ study is an isolated, unreplicated 
study. As will soon be clear, RJ is one of scores of studies indicating 
significant effects of interpersonal expectancy. 

In addition, there are many other equally erroneous theses in ES to 
which we shall respond. 

Before responding to ES in detail^ we want to emphasize the basic 
simplicity of purpose and design of the RJ experiment. The intent was to 
study the effect of favorable teacher expectancy on pupil performance. 

The simplest experiment RJ might have done would have been to randomly ^sign 
some children to a condition of favorable teacher expectation and to retain 

' i 

the remaining children as controls. Because of the randomization, the average 
difference in posttest scores between the experimental and control group children 
would be an unbiased estimate of the effect of favorable teacher expectancy 
for the population for which the children are representative. In order 
to guide of^'s judgment as to whether the measured expectancy effect is 
real in the sense of replicable, some significance testing may often be 
desirable. To make such testing more powerful, that is, more able to detect 

o 

real effects when they do, in fact, exist, we often try to control other j 
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sources of variation besides the treatment. Thus, the randomization in the 
RJ experiment was done within blocks of classrooms and a concomitant variable, 
the pretest, correlated with posttest, was recorded. Blocking and adjusting 
for individual differences on the pretest are procedures designed to in- 
crease the precision of the measurement of the expectancy effect or, equivalently, 
to increase the power of a test of the significance of the effect. 

In what follows we shall demonstrate not only that the reanalyses in 
ES strongly support the conclusions of the RJ report but also that generally 
the criticisms offered in ES are unsound. 

I 

2 . Additional Evidence for the Pygmalion Effect 

It is consistently claimed in ES that wide differences in results arise 
when different dependent variables (posttest scores, gain scores, adjusted 
post test scores) are employed and/or when the dependent variables are 
"transformed” (untransformed, renormed, truncated) and/or when various 
nonparametrlc methods are used. Despite the varied procedures employed 
in ES, the expectancy effects found in RJ remain undlmlnlshed . 

Table 1 compares the RJ dependent variable (untransformed gain score) } 
for total IQ with the eight other ES dependent variables for total IQ, 

(Unless further specified, references to IQ are to total IQ.)- Within 

each grade level employed by ES, the RJ score and the 95% confidence interval 

for the RJ score are given along with the mean, median, lowest, and highest 

f 

of the eight other scores. The means and medians of the ES scores agree 
remarkably well with the RJ scores. In addltlcii, all ES scores fall well 
within the 95% confidence Intervals for the RJ scores and thus are thoroughly 
consistent with them. In fact, the eight other ES scores are significant 
(t^o-tall, £< .05) if and only if the RJ score was significant (two-tall, 

£< .05) (note last column of Table 1). Clearly, then, these ES procedures 
reaffirm the validity of the RJ conclusions, and we are grateful to ES 
for the effort they expended in tabulating these additional dependent 
variables. 

We aire also grateful to ES for having redrawn one of the RJ flgiires, 
thereby suggesting our Figure 1 . In their improvement over the RJ figure, 

ES tabulated the data non-cumulatlvely and showed the proportion of ' 
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children of grades one and two gaining varying amounts of IQ. However, they 
failed to note the statistical significance of the results they displayed, 
•Based on ES' display of the data, Table 2 and Figure 1 show that there is 
a marked linear regression in the proportlo.^s (Snedecor and Cochran, 1967, 
pp. 246-247) of children who are experlmentals on increasing levels of IQ 
gain (£ = .0012, one-tall). (Unless otherwise spe'^ifled, all subsequent £ . 

values are one-tail.) Thus, while less than 8% of the children gaining 
less, than 10 IQ poilnts. are in the experimental group, over 44% of the 
children gaining 30 or more IQ points are in the experimental, group. 

Assuming no effects of teacher expectation' we would expect about 17% of the 
children in either of these categories to be in the experimental group. 

Table 3 and* Figure 2 show the same analysis for posttest scotes. Not 
surprls.ingly, the results indicate a similar linear trend, which is equally 
significant. 

Another analysis comparing the proportions of experimental and control 
group children showing high posttest or gain scores is even more elementary. 
We employed the concept suggested in ES that, since there are 19 experimental 
children iu the first two grades, the topmost 19 gain scores or posttest 
scores should be earned disproportionately often by the children of the 
experimental group. Seven of the Cop .19 gain scores were earned by 
children of the experimental group, more than twice as many us we would 
expect to find by chance (£ < ,02) . Table 4 shows the results of this 
analysis and the results of the same analysis performed on posttest scores. 

As it. turned out, the results wer»- identical and hence significantly 
supported the expectancy hypothesis. 

The similar analysis performed in ES was done within sex and classroom. 
Note that the top 19 children chosen by the ES method are not necessarily 
the top 19 children of the entire sample of 114 children from the first two 
grades. -^Tl^elr analyses yield £> .05 for gain scores arid £ < ,001 for 
pos'ttest scores. ES reported the nonsignificant result Of their peculiar 
metho(j^ of analysis, but failed altogether to mention the highly significant 
result in also yielded. Regrettably this failure to report th results 
of significance tests that do not support the null hypothesis is not an 
isolated instance, as we shall now Indicate. 
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Table 2 

Testing a Linear Regression of on IQ Gain 
Gain in IQ Points 



Treatment 


G < 10 


10 < G < 20 


20 < G < 30 


G > 30 


Tot 


Control (C) 


48 


29 


13 


5 


95 


Experimental (E) 


4 


6 


5 


4 


19 


Total (T) 


52 


35 


18 


9 


114 


Ei = E/T 


.077 


.171 


.278 


.444 


.167 



First order differences +1 0914 +.107 +.166 

b = . 112 ' 

^ = .037 

^ = 3.03 

]£ = .0012, One- tail 

Table 3 



Testing a Linear Regression of £. on' IQ Posttest 

^ C 



Treatment 


Lowest S2^ 


Next 35^ 


Next. 18^ 


Highest 9^ 


Total 


Control (C) 


48 


28 


15 


4 


95 


Experimental (E) 


4 


7 


3 


5 


19 


Total (T) 


52 


35 


18 


9 


114 


£. = E/T 


.077 


o 

o 

CM 

• 


■ .167 


.556 


.167 



First order differences +.123 -.033 +.389 



b = .112 

a = .037 

, • 

Z •= 3.03 

= .0012, One- tail 

s 

Based on. Ns given in ES Figure 2b. 
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Fig. 2 Proportion of Children Who Are Experimentals Showing 
Various Levels of Total IQ- Posttest Scores 
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Table 4 



Children Earning 19 Highest Scores 
(Grades 1 and 2) 

' . Post Scores Gain Scores 



% of 19 Experimental Children (Pg) 


37% 


37% 


% of 95 Control Children (P ) 

c 


' 13% 


13% 


Difference 


24% ’ 


24% 


■ 

• J 

Z 


5.05 

.A", 

^ + 2*25 


5.05 


+ 2.25 


one- tall £ 


.0122 ^ 


.0122 


h". 


0.5^7 


.0.57 


Approximate Magnitude, 


Medium 


‘ Medium 



(Cohen, 1969) 



h is defined as (2 arcsin^Tp ) - (2 arcsinl/p" ) 
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Table 5 



Percentage of Classrooms Showing Expectancy Advantage 





\ 


Posttest 


Gain 






Total N 


'X. 


Oh^-tail £ 


% 


One- tail £ 


Total IQ 


17 


76% 


.025^ . 


65% 


.166® 


N 

Verbal IQ ' 


18 


61% 


.240^ 


67% 


a ' 

.119 


Reasoning IQ 


'17 


76% 


.025^ 


88% 


.001^ 



Reported in ES 



Not reported In ES . 



0 --. 





<1 



• ^ 
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In the discussion of the analysis by classrooms across, all grades (ES tables 
23 'at)d 24), six low power (Cohen, 1969, pp. 35, 155) significance tests were 
per,formed on‘ posttest scores and gain scores. Of these six, two were 
, specifically mentioned in ES and both' were nonsignificant. Of the remaining 
four not specifically mentioned, three were significant at £ < .025; and all six- 
were in the predicted direction (Table 5). Similarly, when examining raw 
gain scores fpr matched children, ES give a Wilcoxon signed-ranks test 
with £ < .05, two-tail, which was subsequently discarded because of some 
mysterious "dubious validity," while a less powerful* sign test found to be 
"nonsignificant" (£ = .059) was not' discarded. A similar kind of sweeping- 
under- the- rug* of "undesirably" low £ values was shown in the evaluation of 
' Pygmalion by J6nsen in his famous paper (1969, p. 107). 

3 . Initial Equivalence of Experimental and Control Croups 
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In summarizing the results of the previous section we emphasize that 
they strongly support the hypothesis of the positive effects of positive- 
interpersonal expectation. Indeed ES seem to be aware of this fact since 

f 

they repeatedly Instruct their readers not to believe the results of 

their, own analyses because of "doubtful ‘ randomization" and "imbalance" 

in the experimental conditions. ' • 

Imbalance oin sanq>le size has . nothing to do with randomization or the 

ability to obtain unbiased -estimates of the effects of teacher expectation. 

To claim that unequal sample sizgs hopelessly confound the analysis of an 

experiment (ES pji. 28, 117) is tp claim that a _conparison of the means of 

two random sanples is confounded if the sdmpie sizes are not equal: this 

' " • ' O ^ 

claim is clearly false." k ■ 

"In additioiV^^^th^6v is" no way in which the idea of "doubtful randomi- 
zaflon"N^n be\<!niployed Jto ' i^ugn the validity of the Pygmalion experiment. 
In the f nla^, as RJ clearly pointed out, the children of the experi- 
melvtal condition were assigned to that condition at random; specif ically, • RJ 
..^§nd . the table of random num^rs provided by Arkin and Colton. (1950).. In 
the second place., when the analyses that have been performed on posttest 

■ • V. y 

and gain scores are performed on the pretest scores, they show no more " 
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difference between the experimental and control group children than would 
be expected by chance. Thus, for example, ES performed 36 overall F 
tests of the significance of the difference between experimental and 
control group children on the pretest and obtained not a single F 
significant at £< .05 (ES Tables 16, 17, 18). If we consider all inter- 
actions of treatment condition with other variables as well as main effects 
of treatment we find that 192 (nonindependent) F tests of .significance 
were made. Of these 192 F tests, only one, a triple interaction, was 

■ . j 

significant at £ < .05, a result that could easily have occurred by- 
chance, yet was singled out for comment in ES. Similarly, when ES analyzed 
pretest differences between experimental and control group children 
employing classrooms as the saiiq>ling unit, they found no significant 
differences (ES Tables .23 and 24) . 

•' It may also be asked whether the linear regressions shown in Figures 
1 and 2 and Tables 2 and' 3 to be significant for. IQ gain and IQ posttest 
might not also be significant for the pretest. Table 6 and Figure 3 
show that this was not the case (£ < 1). 

Fl^lly, employing the method of the "top 19" children introduced in 
ES, Wecan determine whether children of the experimental condition were 
oveirrepresen ted among the children earning the highest 19 scores on the 
total IQ pretest. Under the hypothesis of successful randomization we 
expect to find about three or four children of the experimental group 
among the top 19. What we find is just what we would" expect under conditions 
of successful randomization; four of the top 19 were members of the 
experimental group (X^ = 0.05, ^ = 1» £ = .82). 

In sunmary, ■ since chlldren'were assigned to the experimental condition 
by means of a table of rando* numbers and ;slhce,' furthdmoye,-. 
dozens of tests on t|ie .distribution of the pretest gave no indication that 
there had been any failure of randomization, it becomes most difficult 
to understand the continued concern shown in ES over "doubtful randomization. 
It must be concluded that ES' basis for not believing the effectiveness, of 
randomization remains obscure and that the validity of the W experimental 
design has been thoroughly confirmed. 
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Table 6 

Testing *a Linear Regression of on Prete st IQ 

•< 

Pretest Levels of IQ 

A fl ’ d fl 

Treatment Lowest 52 Next 35 • Next 18 Highest 9 Total 



Control (C) 


44 


31 


13 ■ 


7 


95 


Experimental (E) 


8 


4 


5 


2 


19 


Total (T) 


52 


35 


18 


9 


114 


Zt = E/T 


.154 


.114 


.278 


. 222 


.167 



First order 

differences -.040 +.164 -.156 




b = 



.035 





2 = 0.95 

2. = .1711 



Based on Ns given in ES' Figure 2b. 
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Percentage of Children Who Are in 
Experimental Group 
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Fig. 3. Proportion of Children Who Are Experimentals Showing 
Various Levels of Total IQ Pretest Scores 
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4. Misleading Citation of Replication Research in ES 



As mentioned earlier, the purpose of all the tests of significance 
performed is basically to evaluate the "reality" of the expectancy effect 
obtained, i.e., to determine its replicabili nder virtually identical 



conditions. There is another sense of repli lity which has to do with 
the ability of the same or other investigators to obtain similar results. 
The latter kind of replication is of particular importance to the be- 
havioral sciences as has been discussed elsewhere in' detail (Rosenthal, 

1966, 1969b). 

In their brief mention of replications of the Pygmalion effect, only 
one study was mentioned by name, a failure to replicate by Claiborn (1969). 
In the doctoral dissertation upon which the Claiborn paper was based, 
it was candidly explained that two of the three teachers whose experimental 
condition was similar to that of the RJ study were either fully aware or 
partially aware of the nature and purpose of the experiment (Claiborn, 
.1968). Regrettably, in his subsequent article, Claiborn (1969) failed 
even to mention this difficulty in his discussion of his results. 
Interestingly, within his three classrooms similar to those in RJ, the 
'tendency to obtain reversed results was strongly related to the teachers' 
degree of awareness of the purpose of the experiment. 

Actually, at the time the Claiborn study appeared, numbers of 
studies showing significant positive effects of teacher expectation had 
been published and/or read at conventions (e.g., Beez, 1968; Burnham and 
Hartsough, 1968; Mdichenbaum, Bowers, and Ross, 1969; Palardy, 1969). 
Therefore, the . citation of only the Claiborn study is misleading. 

Table 7 has. been provided to give the reader an up-to-date picture of 
the tesults of studies of interpersonal expectation. Though many of , the 
studies summarized are very recent, most of them have been summarized 
elsewhere (Rosenthal, 1969b, 1971). The first column , shows for studies 
of teacher and counselor expectations the percentage yielding results at 
the .05, .01, and .001 levels of significance in either direction and 
the percentage yielding nonsignificant results. The second column gives 
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Table 7 

Percentage of Studies Reaching Given £. Levels 





Type 


of Study 






Teachers 


' Experimenters 


Total 


Significance Level ; 


(N=37) 


(N=162) 


(N=199),; 

i 


£< .05 (one- tail) 








% in Predicted Direction 


387, 


337, 


347, ' 


7, in Unpredicted Direction 


07, 


. 4‘’'7, 


-4“ 7, 


% Not Significant 


627, 


637, 


637, 


£< .01 (one- tail) 








% In Predicted Direction 


14% 


147, 


147, 


7. In Unpredicted Direction 


0% 


17, 


17, 


7. Not Significant 


867, ■ 


857, 


857, 


£ < .001 (one- tail) 








i In Predicted Direction 


117, 


97, 


107, 


7. In. Unpredicted Direction 


07, 


07, 

1 


07, 


7. Not Significant 


897, 


917, 


907, 



15 



15 



the corresponding data for studies conducted in lah 'ratories rather than 
in everyday life situations. The percentages of studies reaching various 
levels of significance agree remarkably well, from studies of teachers to 
studies of experimenters. Considering those studies that are significant 
in the predicted direction vs those that are not, all three X s are less 

„ ^ than one. It seems reasonable, then, to see both kinds of studiesl.of 

' interpersonal expectation as coming from a common population, ^nd the 
third column of Table 7 shows the combined results. If there were no 
expectancy effect, we would expect to find about 10 studies of Interpersonal 
expectation to have reached a £< *05 in the predicted direction; however, 

67 studies have reached or exceeded that level, a virtually unobtainable result 
if there were no effect^of Interpersonal expectation. 

In sum, the weight of the repllcatlonal evidence is very heavy, based 
as it is on the work of many investigators in many laboratories throughout 
the country. Although no experimental results in the behavioral sciences 
can be expected to show £ < .05 in every study or even every other study, 
the ability of the effects of Interpersonal expectancy to be demonstrated 
over a wide variety of dependent v’arlables, inyestlgators , laboratories, 
states, and even countries suggests a robustness not common to the ephemeral 
phenomena of the behavioral sciences. The Pygmalion effect is real. 

' . ' 

5. Other Criticisms 

Before going on to c o n si.deJ ^ ^ isms-ln~ E S 7 we summarize very 

briefly what has been reported to this point t 

(a) The Pygmalion effect does not depend upon the particular method of 

^ data analysis entployed. This fact is clear using the evidence provided in 

ES. 

(b) The experiment waa'fully randomized and there is no reasoA to doubt 
the initial equivalence pf the experimental and- contrtol groups. This 

fact is clear using the evidence provided by approximately 200 tests 

performed in ES. - 

(c) Pygmalion is not an Isolated study of Interpersonal expectation. 

This fact is clear based tipon results of scores of studies including many 
dealing specifically with teacher expectations. 

In addition to the’ criticisms refuted above, there are other unsound criticisms 

O 
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of Py gma 1 1 on put forward in ES. 

(1) ES imply that RJ should have employed stepwise regression In, their 
analysis of a fully randomized experiment . At best, when all the appropriate 
interactions are entered, stepwise regression will give the same results as 
an analysis of variance. More usually, interactions and nonlinear trends 
are not entered, in which case stepwise regression eliminates important 
estimates and displays, and usually inflates the residual variance. In 
addition, stepwise regress'ion inclines the user to assess the importance 

r!) 

of a phenomenon using only the percentage of variance explained and to. 
ignore not only the expected difference between means but even the direction 
of the effect (e.g. see ES Tables 11, 12, and 13). 

(2) ES imply that RJ should have employed a rigid null hypothesis decision 
procedure . An ES imperative is to interpret no relation unless £ < .05 and 

to report ^ values less than .01 as < .01’. The wisdom of this null hypothesis 
decision approach has been called into serious question not only by psychologists 
(Rosenthal, 1968; Rozeboom, 1960) but by a number of eminent statisticians 
as well. R. A. Fisher, for example, showed little patience with advice of 
the sort offered in ES, i.e., handy hints as to hqw and when to accept or 
reject hypotheses (Cochran, 1967). Fisher preferred to keep track of what- 
ever value was obtained and to wait and see what happened ^^ubs.equent 

observations. FinaHyj^_jwe_ find -the—ES Orientation toward £ values 
Shdrpughly inconsistent with the mental* set they recommend, namely that of 
a detective rather than that of an attorney. . 

(3) ES imply that RJ*s claim to increasing effects of teacher expectation j 
in going from higher to lower grades is untenable. However, the RJ data ^ 
showed a significant interaction of treatment with linear regression of 
grades (£ = -2 69, ^ = 308, £< .01, two- tail, Snedecor and Cochran, 1967, 

p. 278) . In order to indicate the magnitude of this linear trend in average 
differences, we give the Pearson £ between grade level and mean expectancy 
advantage per grade: £ = -.86 (RJ, p. 74). One display of this trend is 
shown in Table 8 and another in Figure 4. These results indicate that there 
is a clear and significant increasing effect of teacher expectation as one 
moves from higher to lower grades. 
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( - Table 8 



Grade 


IQ 


Expectancy Advantage 

a 

Points S.D. Units 


in Total IQ Gain After 
One-tail £ < .05 


One Year 

Approximate Magnitude 
(based on Cohen, 1969) 


1 


+ ; 


A 

15.4 


+ .83 


^ . 002 . 


large 


2 


+ 


9.5 


+ .51 


.02 


medium "\ 


3 


- 


0.0 


- .00 

\ 


— 


\ ^ 

zero 


4 


+ 


3.4 


+ .18 


** ** / 


small 


5 


- 


0.0 


- .00 





zero 


6 


- 


0.7 


- . 04 


— 


tiny (and reversed) 


Total 


+ 


3.8 


+ .21 


.02 


small 


a 

.. a - 


18.48 


based on 


pretest total 


>■ 

IQ of all available children, N = 382. 



Table 9 

^ _ ^ 

ExpectajK:}^ Advantage- in -Reading- Score Gain After One Year 

Approjtimate Magnitude 

Grade Reading Scores S.D. Units^ One-tail £ < .05 (based on Cohen, 1969) 
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■f .55 




+ .56 
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• 

00 




+ 

• 

00 


.05 
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medium 


3 


.♦+ .42 




+ .42 


.04 
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4- . 


+ 

• 

o 




+ .07 


— 


very small 


5 


- .02 




- .02 


— 


tiny (and reversed) 


6 


+ 

• 

o 

00 




+ .08 


— 


very small 


TotalJ 


+ .17 




. + .17 

1 


. .05 

c . 


sma 11 



^ a = 0.99 based on pretest reading scores of all ayail.able children, N = 313. 
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(4) ES imply that RJ should have employed the various ES data trans - 
formations. However, these transformations are statistically biased. 

Using the interval of 60-160, ES renormed by setting scores outside the •• 
range equal to. the endpoints and truncated by discarding children out- 
side the range. These would not have been biased procedures if they 
had been carried out only on pretest scores, even , though they might resf'/ict 
the generalizeability of the resultant analyses. On the other hand, when 
these procedures are applied to posttest scores they are biased and tend 
to diminish any real differences between the experimental and control 
groups. Specifically, if the experimental condition tends to increase or 
decrease scores, the above procedures would tend to distort or discard 

t 

experimental scores more often than control scores thus making the means 

/ 

of the experimental and cc^ntrol groups more similar. For example, if one 
discarded all subjects whose posttests did not equal 100, the experimentals ' 
and controls woul d not dipfer— on posttest. 

T5) 1:S imply that RJ obtained effects that were trivial in magnitude 

even though they may havfe been significant statistically' . In their^ , 
discussion of the effects of teacher Expectation on reading grades, ES 
point out that none of the differences in gains between experimental and 
cdntrol groups is as large as one full grade point equivalent (a.g., the 
difference between a grade of B and C) . Since the standard .deviation of 
the pretest reading grades was less than unity, ES appear to require 
an effect size to be larger than a standard deviation in order for it to 
be regarded as important. Such requirements, exceeding considerably a reason- 
able definition of even a large effect size (Cohen, 1969, p. 24) are very 
questionable. The actual effect sizes for reading scores are shown to 
be at least medium size in three of the six grades (Table 9). Note 
also the similarity of effect sizes between the expectancy advantages 
in reading score gains (Table 9) and total -IQ gains (Table 8) ; th.e 
correlation between these two measures over the, six grade levels is 
+.74 (RJi p. 100). 

(6) ES imply that the RJ dependent variables are unsuitable measures 
of intellectual performance . We find in ES a concern over the "low" 
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reliability (£ '= .74, Column 1, RJ Table A-30) of TOGA along with the 
implication that this threatens the validity of the Pygmalion experiment.' 

I • 

Actually, unreliability (increased noise) ^^n never account for the 
significant results of a fully randomized exp^eriment; rather it can serve 
only to reduce power. We find also in ES the argument that the correlation of 

.65 between TOGA .and subsequent ability track placement given in Rosenthal (l969a) 
does not adequately demonstrate •validity. .. That^ correlation is higher than the 
correlation between scores on the nonverbal section of the Lorge-Thorndike 
and soores on the very same test retaken after an intervening summer. . ' 

Finally, correlations between TOGA and other tests of intellecti^al - " . 

performance are even higher (e.g., T^GA with Lorge-Thorndike: £ = .73). 

Another recommendation -f ound ■ in ES is to employ raw scores as the dependept 
variable instead of IQ% We prefer-to use TQ scores since it is IQs, not , 

raw scores, that are used in tfi'e 'real world to 'inake decisions. 

(7) ES imply that RJ wgs insufficiently reviewed prior to publication . • 

We feel, on 'the contrary, that RJ was unusually thoroughly reviewed prior . 
to publication. In addition to having prior journal publication, the RJ research 
was solicited and approved for inclusion in a volume prepared for Divisionv9 
of the American Psychological Association, Social Class, .Race, and Psycho- 
logical Development (Holt,^ Rinehart .& Winstori, 1968), edited by Martin . 

Deutsch, Irvin Katz, and Arthur Jensen. ‘Numerous- other scholars in the 
behavioral sciences have requested permission to ^reprint the .RJ research 

ip. bheir own volumes of readings, both before and after RJ was published. 

In addition,, the award comnlttee of Division 13 of the American Psychological 
Association presented the first prize of the Cattell Fund Award to the RJ 
research in 1967. 

Given space, we could continue to refute criticisms of RJ and indicate 
many other errors in ES, but we feel that our point has been made. 
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6. Conclusions 
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, We now conclude this response to the. criticisms of Pygmalion (RJ) 
given in Elashoff and Snow (1970)-(-ES) , having demonstrated the following: 
' (a) The results of the varied ES analyses are absolutely consistent 
’with the results of the/ RJ analy.ses ^pnd indicate a significant effect of 
teacher expectations. - 

'(b) ^RJ was a completely randomized exf^priment and- the numerous ES 

• - * . ' •' 

tests of the success of the randomization ^iye absolutely ho reason to 
► doubt the pre-experimental. equivalence of the experimental and control 
groups and thus no reason to doubt the validity of* the conclusions above. 

(c) Positive effects of favorable interpersonal expectations have '• 
been obtained in ntS^nerous experiments conducted by dozens of researchers 
and thus the result in RJ can in ‘ no sense he considered a fluke. C, 

(d) Although there 'were among the ES criticisms a few useful notions 
"^ich we employed in this reply, in the main, the "numerous criticisms 

advanced in ES.were -neither sound nor constructive. 
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